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Abstract 

Markov modulation is versatile in generalization for making a simple stochastic 
model which is often analytically tractable to be more flexible in application. In 
this spirit, we modulate a two dimensional reflecting skip-free random walk in such 
a way that its state transitions in the boundary faces and interior of a nonnegative 
integer quadrant are controlled by Markov chains. This Markov modulated model 
is referred to as a 2d-QBD process according to Ozawa [^. We are interested in 
the tail asymptotics of its stationary distribution, which has been well studied when 
there is no Markov modulation. 

Ozawa studied this tail asymptotics problem, but his answer is not analytically 
tractable. We think this is because Markov modulation is so free to change a model 
even if the state space for Markov modulation is finite. Thus, some structure, say, 
extra conditions, would be needed to make the Markov modulation analytically 
tractable while minimizing its limitation in application. 

The aim of this paper is to investigate such structure for the tail asymptotic 
problem. For this, we study the existence of a right subinvariant positive vector, 
called a superharmonic vector, of a nonnegative matrix with QBD block structure, 
where each block matrix is finite dimensional. We characterize this existence under 
a certain extra assumption. We apply this characterization to the 2d-QBD process, 
and derive the tail decay rates of its marginal stationary distribution in an arbitrary 
direction. This solves the tail decay rate problem for a two node generalized Jackson 
network, which has been open for many years. 

Keywords: Subinvariant vector, QBD structured matrix, Markov modula¬ 
tion, two dimensional reflecting random walk, generalized Jackson network, 
stationary distribution, large deviations. 


1 Introduction 


Our primary interest is in methodology for deriving the tail asymptotics of the stationary 
distribution of a Markov modulated two dimensional reflecting random walk for queueing 
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network applications, provided it is stable. This process has two components, front and 
background processes. We assume that the front process is a skip-free reflecting random 
walk on a nonnegative quarter plane of lattice, and the background process has finitely 
many states. We are particularly interested in a two node generalized Jackson network 
for its application. 


According to Ozawa [3g , we assume the following transition structure. The state space 
of the front process is composed of the inside of the quarter plane and three boundary 
faces, the origin and the two half coordinate axes. Within each region, state-transitions are 
homogeneous, that is, subject to a Markov modulated random walk, but different regions 
may have different state-transitions. Between pairs of the four regions, state-transitions 
may also be different. See Figure[T]in Section ITT] for their details. This Markov modulated 
two dimensional random walk is called a discrete-time 2d-QBD process, 2d-QBD process 


for short, in 3q. We adopt the same terminology. This process is flexible enough to 


handle many two node queueing networks in continuous time through uniformization. 
The generalized Jackson network is such an example. 


For the 2d-QBD process, we assume that it has a stationary distribution, and denote 
a random vector subject to it by {L, J), where L represents a random walk component 
taking values in while J represents a background state. For i = 1,2, we consider 
the tail asymptotics by logarithmic ratios of the stationary tail probabilities in the Tth 
coordinate directions: 


— logP(Lj > n, L 3 _i = i, J = k), n ^ oo, (1.1) 

n 


for each fixed > 0 and background state k, and those of the marginal stationary distri¬ 
bution in an arbitrary direction c = (ci, C 2 ): 


— logP(ciLi J-C2T2 > x), X ^ 00. 

X 


( 1 . 2 ) 


It will be shown that those ratios converges to constants (Theorems 13. 2l and l3.3p . They are 
negative, and their absolute values are called exponential decay rates. We demonstrate 
those tail asymptotic results for a two node generalized Jackson network with Markov 
modulated arrivals and phase type service time distributions. This solves the problem 
which has been open for many years (see Section W?2\ for details). 


Ozawa [ 3 ^ studied the tail asymptotics in the coordinate directions including (11.11) . 
He showed that the method for a two-dimensional reflecting random walk studie d by 


Miyazawa 271 is applicable with help of invariant vectors obtained by Li and Zhao 12|. 


We refer to this method as a QBD approach, which is composed of the following three 
key steps. 


1) Formulate the 2d-QBD process as a one dimensional QBD process with inhnitely 
many background states, where one of the coordinate axes is taken as a level. 

2) Find right and left invariant vectors of a nonnegative matrix with QBD block struc¬ 
ture, which will be introduced shortly, and get upper and lower bounds of the tail 
decay rates. 
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3) Derive the tail decay rates, combining those results in the two directions. 


Here, an inhnite dimensional square matrix is said to have QBD block structure if it is 
partitioned into blocks in such a way that each block is a square matrix of the same size 
except for the hrst row and hrst column blocks, the whole matrix is block tridiagonal 
and each row of blocks is repeated and shifted except for the hrst two rows (see (12.51) 
for its dehnite form). In step 1), the blocks for the one dimensional QBD are inhnite 
dimensional, while, in step 2), those for the nonnegative matrix are hnite dimensional. 


A hard part of this QBD approach is in step 2). In [36j, the invariant vectors are only 
obtained by numerically solving certain parametrized equations over a certain region of 
parameters. This much degrades applicability of the tail asymptotic results. For example, 
it is hard to get useful information from them for the tail asymptotics in the two node 
generalized Jackson network (see, e.g, [l^, 15|). We think this analytic intractability can 
not be avoided because no structural condition is assumed for the Markov modulation. In 
applications, it may have certain structure. Thus, it is interesting to hnd conditions for the 
invariant vectors to be analytically tractable while minimizing limitations in application. 


Another problem in is complicated descriptions. They can not be avoided because 
of the complicated modeling structure, but we easily get lost in computations. We think 
here simplihcation or certain abstraction is needed. 


In addition to those two problems, the QBD approach is not so useful to study the 
tail asymptotics in an arbitrary direction. For this, it is known that the stationary in¬ 
equalities in terms of moment generating functions are useful in the case that there is no 
Markov modulation (e.g., see [l9, 3). So far, it is interesting to see whether this moment 
generating function approach still works under Markov modulation. 


We attack those three problems in this paper. We hrst consider the description prob¬ 
lem, and hnd a simpler matrix representation for a nonnegative matrix with QBD block 
structure. This representation is referred to as a canonical form. We then consider the 
problem in step 2). 


For this, we relax the problem by considering a right subinvariant positive vector, 
which is said to be superharmonic, instead of a right invariant positive vector, which is 
said to be harmonic. It is known that the existence of a right subinvariant vector is equiv¬ 
alent to that of a left subinvariant nonnegative vector (e.g., see ji^). When a nonnegative 
matrix is stochastic, a right subinvariant vector can be viewed as a superharmonic func¬ 
tion. Because of this fact, we use the terminology superharmonic vector. In the stochastic 
case, it obviously exists. When the matrix is substochastic and does not have the bound¬ 
ary blocks, this problem has been considered in studying a quasi-stationary distribution 
for QBD processes (see, e.g., jlTI. l23l. l24|). 


In step 2), we do not assume any stochastic or substochastic condition for a nonnega¬ 
tive matrix with QBD block structure, which is crucial in our applications. As we will see, 
we can hnd necessary and sufhcient conditions for such a matrix to have a superharmonic 
vector (see Theorem [2T]). The sufficiency is essentially due to Li and Zhao [2^ and related 
to Bean et ah (see Remarks 12.II and l2. 21) . However, this characterization is not useful in 
application as we already discussed. So, we will assume a certain extra condition to make 
an answer to be tractable. Under this extra assumption, we characterize the existence of 
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a superharmonic vector using primitive data on the block matrices (Theorem [2]2]). 

This characterization enables us to derive the tail asymptotics of the stationary dis¬ 
tribution in the coordinate directions for the 2d-QBD process. For the problem of the 
tail asymptotics in an arbitrary direction, we show that the moment generating func¬ 
tion approach can be extended for the Markov modulated case. For this, we introduce a 
canonical form for the Markov modulated two dimensional random walk, which is similar 
to that for a nonnegative matrix with QBD block structure. 


There has been a lot work on tail asymptotic problems in queueing networks (see, e.g., 
28(1 and references therein). Most of studies focus on two dimensional reflecting processes 
or two node queueing networks. The 2d-QBD process belongs to this class of models, but 
allows them to have background processes with hnitely many states. There is a huge gap 
between finite and infinite numbers of background states, but we hope the present results 
will stimulate to study higher dimensional tail asymptotic problems. 


This paper is made up by five sections and appendices. Section [2] drives necessary 
and sufficient conditions for a nonnegative matrix with QBD block structure to have a 
right sub-invariant vector with and without extra assumptions. This result is applied to 
the 2d-QBD process, and the tail decay rates of its stationary distribution are derived 
in Section |3l The tail decay rates of the marginal stationary distribution in an arbitrary 
direction are obtained for the generalized Jackson network in Section (H We hnally give 
some concluding remarks in Section [S] 


We summarize basic notation which will be used in this paper (see Tables 1 and 2). 


Z the set of all integers, Z+ 

M the set of all real numbers, M+ 

H {-1,0,1}, H+ 

{x, y) xiyi + X 2 I /2 for x,y e 1 


the set of all nonnegative integers, 
the set of all nonnegative real numbers, 
{ 0 . 1 }, 

the column vector whose entries are all units 


Table 1; Notation for sets of numbers and vectors 


For nonnegative square matrices T, Tj,Tij with indices i,j G Z such that Ti and Tij 
are null matrices except for hnitely many i and j, we will use the following conventions. 

Cp(T) sup{m > 0; convergence parameter of T, 

7pf(T) the Perron-Frobenius eigenvalue of T if T is hnite dimensional, 
while it equals Cp{T)~^ if T is inhnite dimensional. 

T*{0) 0 G M: the matrix MGF of {Tj}, 

where MGF is for moment generating function, 

^ ^ matrix MGF of {Tij}, 

^(■i(.) ^(t;)( 9) = 7„(r.(9)), = 7„(r..(9)). 

(/ — T)~^ is inhnite if Cp{T) < 1), 

Aa; the diagonal matrix whose i-th diagonal entry is Xt, 

where Xi is the Gth entry of vector x. 

Table 2: Gonventions for matrices and their MGF 


Here, the sizes of those matrices must be the same among those with the same type 
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of indices, but they may be infinite. We also will use those matrices and related notation 
when the off-diagonal entries of T, Tj,Tjj are nonnegative. 


2 Nonnegative matrices and QBD block structure 


Let iL be a nonnegative square matrix with inhnite dimension. Throughout this section, 
we assume the following regularity condition. 

(E^) K is irreducible, that is, for each entry (f, j) of K, there is some n > 1 such that 
the (i, j) entry of iL” is positive. 

2.1 Super harmonic vector 

In this subsection, we do not assume any assumption other than (Eii), and introduce some 
basic notions. A positive column vector y satisfying 

Ky<y (2.1) 

is called a superharmonic vector of K, where the inequality of vectors is entry-wise. The 
condition fl2.ip is equivalent to that there exists a positive row vector x satisfying xK < x. 
This X is called a sub-invariant vector. Instead of (12.ip . if, for m > 0, 

uKy < y, (2.2) 

then y is called a w-superharmonic vector. We will not consider this vector, but most 
of our arguments are parallel to those for a superharmonic vector because y of (12.21) is 
superharmonic for uK. 

These conditions can be given in terms of the convergence parameter c^jK) oi K (see 
Table [2] for its dehnition). As shown in Chapter 5 of the book of Nummelin [3J| (see also 
Chapter 6 of [d^). 


Cp{K) = sup{m > 0; uKy < y for some y > 0}, (2,3) 

or equivalently Cp{K) = sup{M > 0; uxK < x for some x > 0}. Applying this fact to K, 
we have the following lemma. For completeness, we give its proof. 

Lemma 2.1 A nonnegative matrix K satisfying has a superharmonic vector if and 
only if Cp{K) > 1. 

Proof. If K has a superharmonic vector, then we obviously have Cp{K) > 1 by (12.31) . 
Conversely, suppose Cp{K) > 1. Then, by fl2.3p . for any positive m < 1, we can hnd a 
positive vector z(u) such that 


uKz{u) < z{u). 


(2.4) 
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Denote the i-th entry of z{u) by Zi{u), and define vector y{u) whose i-th entry yi{u) is 
given by 

yi{u) = mm{l,Zi{u)/zo{u)). 

Then, it follows from fl2.4p that yo{u) = 1, yi{u) < 1 for all i, and 

uKyiu) < y{u). 

Taking the limit inhmum of both sides of the above inequality as m t 1, and letting 
y = liminf„-|-i y{u), we have fl2.1l) . Thus, K indeed has a superharmonic vector y, which 
must be positive by the irreducible assumption ([2^). □ 

The importance of Condition (12.Ih lies in the fact that A~^KAy is substochastic, that 
is, K can be essentially considered as a substochastic matrix. This enables us to use 
probabilistic arguments for manipulating K in computations. 


2.2 QBD block structure and its canonical form 


We now assume further structure for K. Let ruo and m be arbitrarily given positive 
integers. Let Ai and Bi for i = —1,0,1 be nonnegative matrices such that Ai for i = 
— 1, 0,1 are m x m matrices, B_i is an tuq x m matrix, Bq is an mo x mo matrix and Bi 
is m X mo matrix. We assume that K has the following form: 


K 


( Bq 


0 

0 

0 

...\ 

B-l 

^0 

Ai 

0 

0 


0 

A_i 

Aq 

Ai 

0 


0 

0 

A-i 

Aq 

Ai 


V 





■7 


(2.5) 


If K is stochastic, then it is the transition matrix of a discrete-time QBD process. 
Thus, we refer to K of (12. 5 p as a nonnegative matrix with QBD block structure. 

As we discussed in Section [H we are primarily interested in tractable conditions for 
K to have a superharmonic vector. Denote this vector hy y = [y^, y^,.. .)^. That is, y is 
positive and satishes the following inequalities. 

Boi/o + Biy^ < j/o, (2.6) 

B^iy^A Aoy^ +Aiy^<y^, (2.7) 

+ Aoj/„ + u = 2,.... (2.8) 


Although the QBD block structure is natural in applications, there are two extra 
equations (12.6p and (12.7p which involve the boundary blocks B^. Let us consider how 
to reduce them to one equation. From (12.6p . — Vo Boy^ ^ y^. Hence^ if 


Cp(Bo) = 1) then y^ must be the left invariant vector of Bq (see Theorem 6.2 of |38|). 
but this is impossible because y^ > 0. Thus, we must have Cp(Bo) > 1; and therefore 
(/ — Bq)~^ is hnite (see our convention (Table [2]) for this inverse). Let 


Co = B_i{I-Bor^Bi + Ao 


(2.9) 
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then fl2.6p and fl2.7p yield 


Coy I + Aiy^ < yi- 


This suggests that we should dehne a matrix K as 


f Co 

Al 

0 

0 

0 

...\ 

A-i 

^0 

Al 

0 

0 


0 

A-i 

^0 

Al 

0 


0 

0 

71-1 

Ao 

Til 


V 







( 2 . 10 ) 


( 2 . 11 ) 


where Cq is defined by 02.91) . Denote the principal matrix of K (equivalently, K) obtained 
by removing the first row and column blocks by Kj^. Namely, 


! Ao Ai 0 0 ■ ■ • \ 

A-i Aq Ai 0 

0 A-i Ao Ai ■ ■ ■ 

\ ■■) 


( 2 . 12 ) 


Lemma 2.2 (a) K has a superharmonic vector if and only if K has a superharmonic 
vector, (b) max(cp(it'), Cp(i^)) < Cp{K^). (c) If Cp{K) > 1, then Cp{K) < Cp(K) < 

Cp{K+). 

Remark 2.1 A similar result for K and is obtained in Bean et al. 


Proof. Assume that K has a superharmonic vector y = [y^^y^,.. .Y. Then, we 
have seen that Cp{Bo) > 1, and therefore (/ — < oo. Define y = fyo^yi) ■ ■ tiy 

Vn — Un+i for n > 0, and define Co by (12.9p . Then, from (I2.10p , we have 


Coyo + Aiy^ < y^. 


This and (12. 8 p verify that y is superharmonic for K. On the contrary, assume that K is 
well defined and y = {yoiVii ■ ■ is superharmonic for K. Obviously, the finiteness of 
K implies that B_i{I — Bo)~^Bi is finite. Suppose that Cp{Bo) < 1, then some principal 
submatrix of (/ — Bo)~^ has divergent entries in every row and column of this submatrix. 
Denote a collection of all such principal matrices which are maximal in their size by Vo- 
Then, all entries {i,j) of submatrices in Vo, we must have, for all n> 0, 


[B- 


11 ki 


s=0 


[Bi]je - 0, 


j ij 


Vfc, £ e {1, 2,..., m}. 


because of the finiteness of i?_i(/ — Bq) ^Bi. This contradicts the irreducibility (|2^) of 
K. Hence, we have Cp{Bo) > 1. Define y = {yo,yi ,...Y as 


yo = {I - Bo) ^Biyo, y^ = y^_^, n > 1, 


7 
















where (/ — Bq) ^ < oo because of Cp{Bo) > 1. Then, from fl2.9p . we have 

CoVi = CoVo = B-iVo + ^oVi, 

and therefore the fact that Coy^ + Aiy^ < implies fl2.7p . Finally, the definition of 
implies fl2.6p with equality, while the dehnition of y^ for n > 1 implies fl2.8p . Hence, 
y is super harmonic for K. This proves (a), (b) is immediate from fl2.3p since 
is superharmonic for JF+ if {y^^y^,.. .)^ is superharmonic for K (or K). For (c), recall 
that the canonical form of uK is denoted by uK for n > 0. If n > 1, we can see that 
uK < uK, and therefore Cp{K) < Cp{K). This and (b) conclude (c). □ 

By this lemma, we can work on K instead of K so as to hnd a superharmonic vector. 
It is notable that all block matrices of K are m x m square matrices and it has repeated 
row and column structure except for the first row and first column blocks. This greatly 
simplihes computations. So far, we refer to K as the canonical form of K. 

In what follows, we will mainly work on the canonical form K of K. For simplicity, 
we will use y = {y^, .. .)^ for a super harmonic vector of K. 


2.3 Existence of a super harmonic vector 

Suppose that K of fl2.1ip has a super harmonic vector y = (^q, y^^.. .y . That is, 

Coj/o + Aiy^ < ^ 0 , (2.13) 

+ A^y^ + <y^, n> 1. (2.14) 

In this section, we consider conditions for the existence of a superharmonic vector. 

Letting Ci = Ai, we recall matrix moment generating functions for {Ai} and {Ci} 
(see Table |2]) : 

Aye) = e-‘^A_i + Ao + yA^, Cye) = Co + e^C,, 6 eR. 

From now on, we always assume a further irreducibility in addition to (E^). 

(EJo) H*( 0 ) is irreducible. 


Since A^{e) and CyO) are nonnegative and finite dimensional square matrices, they have 
Perron-Frobenius eigenvalues y^*y9){= 7 pf(H*( 6 '))) and y^*\9){= 7 pf(C'*( 6 *))), respec¬ 
tively, and their right eigenvectors h^^*\9) and h^^*\9), respectively. That is, 

Ay9)h^^*\9) =y^*\9)h^^*\9), (2.15) 

cye)h^^*\e) = y^*\ 9 )h^^*\e), ( 2 . 16 ) 


where Cy9) may not be irreducible, so we take a maximal eigenvalue among those which 
have positive right invariant vectors. Thus, h^^*\9) is positive, but h^^*\9) is nonnegative 
with possibly zero entries. These eigenvectors are unique up to constant multipliers. 


It is well known the y^*\9) and y'^*\9) are convex functions of 9 (see, e.g.. Lemma 
3.7 of 3^). Furthermore, their reciprocals are the convergence parameters of H*(0) and 













C^{9), respectively. It follows from the convexity of and the fact that some entries 

of A^{9) diverge as 16^1 —?■ oo that 

lim 'y^^’‘\9) = lim 'y^^*\9) = +cxo. (2-17) 

0 — y —cx) 0 —^-|-oo 

We introduce the following notation. 

= {9e R;-f^^*\9) < 1 }, = {9e R;'y^^*\9) < 1 }, 

where 7 ^ 0 implies that Cq is finite, that is, Cp(i?o) > 1- By fl2.17l) . F^'^^ is a bounded 
interval or the empty set. 

In our arguments, we often change the repeated row of blocks of K and K so that 
they are substochastic. For this, we introduce the following notation. For each 6 ^ G M and 
h^^*\9) determined by fl2.15p . let 

= e £ = 0, ±1, 

where we recall that A^ is the diagonal matrix whose diagonal entry is given by the same 
dimensional vector a. Let 

^( 0 ) _ 

Note that = A“('; 4 ^)^^^A*( 6 *)A^(A,)(g), and therefore = '^^^*\9)1. 

The following lemma is the first step in characterizing Cp{K) > 1. 

Lemma 2.3 (a) Cp(iF+) > 1 if and only z/F^*^^ 7 ^ 0, and therefore Cp{K) > 1 implies 
^ 0. (b) Cp{K+) = {mm{j^*{9);9 E R})-\ 


This lemma may be considered to be a straightforward extension of Theorem 2.1 of 
Kijima 17| from a substochastic to a nonnegative matrix. So, it may be proved similarly, 
but we give a different proof in Appendix There are two reasons for this. First, it 
makes this paper selfcontained. Second, we wish to demonstrate that it is hard to remove 
the hniteness of m on block matrices. 


We now present necessary and sufficient conditions for K, equivalently K, to have a 
superharmonic vector. 


Theorem 2.1 (a) 7 ^ 0, then N = (J—JF+) ^ is finite, and therefore G_ = AiiA_i 

is well defined and finite, where Nn is the (1, l)-entry of N. (b) Cp{K) > 1 holds if and 
only if F^'^^ 7 ^ 0 and 

7 pf(C'o + AiG-) < 1 . (2-18) 

If the equality holds in h2.1^) . then Cp{K) = 1. 


Remark 2.2 The sufficiency in ('b') is essentially obtained in Theorem 6 of [2^, which is 
used in Sections 3.4 and 3.5 of (SGj, where the eigenvalue 7 pf(Go + AiG-) corresponds to 
no(l) in We do not need the function u n(0) there because we work on a nonnegative 
matrix while substochasticity is assumed in j24| . 
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Proof, (a) Assume that 6 G ^ 0, then we can find a 6i such that 9i = argg min{ 6 * G 
M; 'y^*(9) = 1}. For this 9i, let y(9i) = .. .y, and let 

A"'* = 

It is easy to see that is strictly substochastic because the first row of blocks is 

defective. Hence, (1 — must be finite, and therefore (I — is also finite. 

This proves (a). 

(b) Assume that Cp{K) > 1, then F^'^^ 7 ^ 0 by Lemma l2Al Hence, (/ — K+)~^ is finite 
by (a). Because of Cp{K) > 1, K has a superharmonic vector. We denote this vector by 
y = {Vnl n = 0,1,.. Let z = n = 1, 2, .. then we have 

CoyQ + Aiy^ < y^, (2.19) 

{A_,y^,0,0,...y + K^z<z. (2.20) 

It follows from the second equation that [(/ — iF+)“^]iiA_i^Q < y^. Hence, substituting 
this into fl2.19p . we have 


{Cq + AiG^y^ < yQ, ( 2 - 21 ) 

which is equivalent to fl2.18p . Conversely, assume (12.181) and F^'^^ y 0, then we have 
fl2.2ip for some yQ > 0. Define z as 

z = {i-Ky-yA_,y„o,o,...y, 


then we get (I2.2np with equality, and (12.211) yield (I2.19p . Thus, we get the superharmonic 
vector (^Q, z)^ for K. This completes the proof. □ 

Using the notation in the above proof, let = (1 _ 


G 


(ei) 




then must be stochastic because it is a transition matrix for the background state 
when the random walk component hits one level down. Furthermore, 

Hence, for m = 1, e~^^G- = 1, and therefore (I2.18p is identical with 

7pf (Go + e^Mi) < 1, (2.22) 

which agrees with 7*'‘"*^(0i) < 1. Hence, we have the following result. 


Corollary 2.1 For m = 1, Cp{K) >1 if and only D Fq^'^^ y 


This corollary is essentially the same as Theorem 3.1 of 27|], so nothing is new tech¬ 
nically. Here, we have an alternative proof. However, it is notable that K may have 
boundary blocks whose size is mo > 1 while m = 1. 
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For m > 2, Theorem 12.Il ls not so useful in a ppl ication because it is hard to evaluate G- 
and therefore it is hard to verify fl2.18p . Ozawa [3^ proposes to compute the corresponding 
characteristics numerically. However, in its application for the 2d-QBD process, G- is 
parametrized, and we need to compute it for some range of parameters. Thus, even 
numerical computations are intractable. 

One may wonder how to replace fl2.18p by a tractable condition. In the view of the 
case of m = 1, one possible condition is that < 1 for some 6 G T^'^^ which is 

equivalent to fl2.22p for general m. However, ypp {Gq + e^^i), which equals is 

generally not identical with qpp (Co + AiG-) (see Appendix O) . So far, we will not pursue 
the use of Theorem 12.11 

2.4 A tractable condition for application 

We have considered conditions for Cp{K) > 1, equivalently, Cp{K) > 1. For this problem, 
we here consider a specihc superharmonic vector for K. For each 6* G M and h > 0, dehne 

yi^) = by 

y^{e) = n > 0. (2.23) 

Then, Ky{9) < y{9) holds if and only if 

A^{9)h<h, (2.24) 

G,{9)h < h. (2.25) 

These conditions hold for y{9) of fl2.23p . so we only know that they are sufficient but may 
not be necessary. To £11 this gap, we go back to K and consider its superharmonic vector, 
using fl2.23p for off-boundary blocks. This suggests that we should replace fl2.25p by the 
following assumption. 

Assumption 2.1 For each 9 G F^^^^ there is an ttiq- dimensional positive vector h^^\9) 
and real numbers co(6*), ci(6*) such that either one of cq{9) or ci{9) equals one, and 

Boh^^\9) + = co{9)h^^\9), (2.26) 

(0) + Aoh^^*\9) + e^Aih^^*\9) = ci{9)h^^*\9). (2.27) 

Remark 2.3 If co(6*) < 1 and ci{9) < 1, then fl2.25p is equivalent to fl2.26p and fl2.27l) . 
However, it is unclear whether or not co(9) = 1 or ci(9) = 1 implies fl2.25p . In particular, 
Ci(9) = 1 is the case that we need in our application to the generalized Jackson network. 
This will be affirmatively answered in Theorem 12.21 

Let 

= {9eR;3h> 0, A,(9)h < h, G,{9)h < h}, 

= {9eR]3h> 0, A,{9)h = h, G,{9)h < h}. 

If Fq^^ 7 ^ 0, Co is finite, and therefore Cp{Bq) > 1. Fg^^ is at most a two point set. Note 
that Fg^^ C Fg^"^^ n F^'^^ but Fg^^ = Fg^'^^ n F^'^^ may not be true except for m = 1. We 
further note the following facts. 
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Lemma 2.4 //Fg^^ 7 ^ 0, then Fq^^ is a hounded convex subset ofR, and it can be written 
as the closed interval respectively, where 

«!„ 1 f ' = 6 r<7>}, e‘±p = sup{« 6 r<“»}. (2.28) 

We prove this lemma in Appendix [B] because it is just technical. Based on these 
observations, we claim the following fact. 


Theorem 2.2 For a nonnegative matrix K with QBD block structure, assume Conditions 
and (a) //Fq^^ 7^ 0, then Cp{K) > 1. (b) Under Assum'ption \2. 1\. Cp{K) > 1 , 
if and only 7^ 0, which can be replaced by Fq^^ 7^ 0. 

Proof. (a) We already know that y{0) of (12.231) is a superharmonic vector of K for 
6 G Fq^\ Thus, Lemma [22] implies (a). 

(b) The sufficiency of Fq^^ 7^ 0 is already proved in (a). To prove its necessity, we hrst 
note that F^^^ is not empty by Lemma [2.31 Hence, there is a 9i such that 6*1 = min{6' G 
= i}_ Por this 61 , we show that fl2.25l) holds for h = h^^*\ 6 i). To facilitate 
Assumption 12.11 we work on K rather than K. Assume that a superharmonic y = 
(^0) yii ■ ■ ■) exists for K. We dehne the transition probability matrix k,i > 

0} by 

“ co(0i)hO)(0p^oA^(o)(e^), Pm - e A 


Pr 


00 


01 


CO 






R_iA, 




6 (0i) 

u 


= £ = 1,2, 


kl 

where Pjfg^^ is the null matrix for {k,t) undehned. It is easy to see that p(®d is a proper 
transition matrix with QBD structure by (12.261) . (12.27!) and = 1. Furthermore, 

as shown in Appendix jA] this random walk has the mean drift f[A.2[) with 6*1 instead of 9q. 
Since the dehnition of 6*1 implies that = 0, this Markov chain is null recurrent. 

We next dehne 


as 


_ A-l ^ 

Vo - ^h(o)(ei)yo> 


P^l) ^ A-1 

Vn 6 


then the 0-th row block of jg 

p{Si)Aei) p(0i) -(ei) _ „ (n N-i A-i _ „ (Q \ 

M)0 Vo + M)1 Vl — Co(i7l) ^/i(o)(5i7?/o ~ Co(t7i) 

and, similarly, the 1-st row block is 


n > 1 , 


-7A 




10 i/o “T 11 i/i “T -'12 y2 
Hence, Ky < y is equivalent to 

/ co(6*i)/o 0 


Vi 


0 

0 


0 

0 


0 

0 

I 


0 

0 

0 

I 


\ 


p{8i)^{8i) ^( 61 ) 


(2.29) 
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where Jq is the mo dimensional identity matrix. We now prove that co{0i) < 1 and 
Ci(0i) < 1 using the assumption that either Co{9i) = 1 or ci(0i) = 1. First, we assume 
that ci{9i) = 1, and rewrite fl2.29p as 


A)(9i)Ao‘’ c„(90d!‘‘’ 

do'' 0 

0 0 


0 

0 

0 



^ie.) < 


0 

0 



V 



V 


... \ 


where /+ and are the matrices obtained from I and respectively, by deleting 

their first row and column blocks. Since Pf^'^ is strictly substochastic, /+ — Pf^'^ is 
invertible. We denote its inversion by U, then 


/ lo 
0 
0 

V ^ 


which yields that 


0 

U 


\ 


c„(9i)P„'S‘> c„(90di‘’ 


<=0(9.) F, 


i(0l) 

10 

0 


0 

0 


00 


_i_ pl^ilrr pv 
+ -^01 <^iiWo 


0 

0 

0 


i0i) \ AOi) 


\ 




y 


(Oi) 


< y 


(01) 


yr < yo 


(01) 


where Uu is (1,1) block of U. Since (^Pqo^^ + is a stochastic matrix by the 

null recurrence of P^^^\ we must have that Co{9i) < 1. The case for Co{9i) = 1 is similarly 
proved. Thus, the proof is completed in the view of Remark 12.31 □ 


2.5 The convergence parameter and u-invariant measure 

We now turn to consider the invariant measure of K, which will be used in our application. 
Li and Zhao 2^ have shown the existence of such invariant measures for uK for u > 
0 when K is substochastic. We will show that their results are easily adapted for a 
nonnegative matrix. For this, we first classify a nonnegative irreducible matrix T to be 
transient, null recurrent or positive recurrent. T is said to be u-transient if 


< oo. 


71=0 


while it is said to be u-recurrent if this sum diverges. For u-recurrent T, there always 
exists a u-invariant measure, and T is said to be u-positive if the u-invariant measure has 
a hnite total sum. Otherwise, it is said to be u-null. The book of Seneta 3^ is a standard 
reference for these classifications. 

Suppose that Cp{K) > 1. We modify K to be substochastic. For this, recall that 
Cp{K) > 1 is equivalent to the existence of a superharmonic vector of K, and that Aq is the 
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diagonal matrix whose diagonal entry is given by vector a. Define K for a superharmonic 
vector y oi K hy 


K = A-^KAy. 


Then, Kl < 1, that is, K is substochastic. It is also easy to see that, for 0 < m < Cp{K), 
X is a. u invariant measure of K if and only if xA~^ is a m invariant measure of K. 
Furthermore, the classifications for K are equivalent to those for K. Thus, the results of 
24l | can be stated in the following form. 


Lemma 2.5 (Theorem A of Li and Zhao |2^) For a nonnegative irreducible matrix 
K with QBD block structure, let t = Cp{K), = Cp(iF+) and assume that t > 1. Then, 
K is classified into either one of the following cases: (a) t-positive ift < t+, (b) t-null or 
t-transient ift = t^. 


Remark 2.4 The t and correspond to a and a of [2^, respectively. In Theorem A 
of 2^, the case (b) is further classified to t-null and t-transient cases, but it requires 
the Perron-Frobenius eigenvalue of t(C'o + R(t)A_i) to be less than 1 for t-transient and 
to equal 1 for t-null, where R{t) is the minimal nonnegative solution X of the matrix 
equation: 

X = t(A^A_i -|- XAq -\- Ai). 

In general, this eigenvalue is hard to get in closed form, so we will not use this finer 
classification. Similar but slightly different results are obtained in Theorem 16 of j^. 


Lemma 2.6 (Theorems B and C of Li and Zhao [2^) For K satisfying the assump¬ 
tions of Lemma 1^.51 there exist u-invariant measures for 0 < u < t = Cp{K). The form 
of these invariant measures varies according to three different types (al) u = t for t- 
recurrent, (a2) u = t for t-transient, and (b) u < t. 


Remark 2.5 By Lemma [2. 5 [ K is t-null for (al) if and only if t = t+. 


3 Application to a 2d-QBD process 

In this section, we show how Theorem 12.21 can be applied to a tail asymptotic problem. 
We here consider a 2d-QBD process {Zn} = {{Lin, L 2 n, Jn)} introduced by Ozawa (j^ . 
where L„ = (Li„,L2n) is a random walk component taking values in and {Jn} is 
a background process with finitely many states. It is assumed that {Zn} is a discrete 
time Markov chain. The tail decay rates of the stationary distribution of the 2d-QBD 
process have been studied in , but there remain some crucial problems unsolved as we 
argued in Section [1] and will detail in the next subsection. Furthermore, there is some 
ambiguity in the definition of Ozawa js^’s 2d-QBD process. Thus, we first reconsider 
this definition, and show that those problems on the tail asymptotics can be well studied 
using Assumption 12.11 and Theorem 12.21 
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3.1 Two dimensional QBD processes 

We will largely change the notation of to make clear assumptions. We partition the 
state space S of Zn so as to apply Lemma 12.21 Divide the lattice quarter plane into 
four regions. 

Wo = {(0,0)}, U^ = {(£,0)eZl■J>l}, W2 = {(0,£)eZ^;£>l}, 

W+ = {(£,£') e Zl;£,£' > 1}, 

where W* for i = 0,1, 2 and IA+ are said to be a boundary face and interior, respectively. 
Then, the state space S for is given by 

5 = (Wo X Vo) U (Wi X Vi) U (Ws X Va) U (W+ x V+), 

where Vi are hnite sets of numbers such that their cardinality |Vi| is given by mo = |Vo|, 
mi = |Vi|, m2 = IV2I, m = |V+|. 

To dehne the transition probabilities of we further partition the state space as 


Uim = {{.£,m)}, £,m = {0,1}, 

W+o = {(n, 0) e Z}_; n > 2}, Wo+ = {(0, n) G Z}_; n > 2}, 

W+i = {(n, 1) e Z ^;n > 2}, Wi+ = {(1, n) G Z ^;n > 2}, 

W++ = {{£,m) G Z‘}_;£,m > 2}. 


On each of those sets, the transition probabilities of are assumed to be homogeneous. 
Namely, for s, s' G Vl = {0,1,+}, their matrices for background state transitions can 
be denoted by A\j^ ^ for the transition from {{£, m),k) G Ugg' to {{£ + i,m + j), k') G S. 
Furthermore, we assume that 


4(10) _ 4 (+ 0 ) 

- ^ij , 


/l(+l) _ /!'.+ 


|(++) 


4“> = 4»+), 4“)=4++), 
4+» = 4++i, 


(3.1) 

(3.2) 


Throughout the paper, we deuote 31)+* by A,,. This greatly simplifies the uotatiou. 
See Figure [T] for those partitions of the quarter plane Z^ and the transition probability 
matrices. 


Those assumptions on the transition probabilities are essentially the same as those 
introduced by Ozawa 3^, while there is some minor flexibility in our assumption that 

different from respectively), which are identical 

in [3^. Another difference is in that we have nine families of transition matrices while 
Ozawa 0 expresses them by four families, for s = 0,1, 2 and Aij. 


By the homogeneity and independence assumptions, we can dehne Zn+i in terms of 


Zn and independent increments as 


Ln+l, Jn+l) — (Ln + \jn)l{Ln E kiss'), Jn+1 


'&A 


(3.3) 
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Uo+ U\+ 



where \k) is the increment at time n when the random walk component on Uss' and 
the background state is k. By the modeling assumption, Xl^^\k) is independent of Zi 
ioT i < n — 1 and Ln for given s, s' and k. 

The 2d-QBD process is a natural model for a two node queueing network under various 
situations including a Markovian arrival process and phase-type service time distributions. 
Its stationary distribution is a key characteristic for performance evaluation, but hard to 
get. This is even the case for a two dimensional reflecting random walk, which does not 
have background states (e.g., see [^). Thus, recent interest has been directed to the tail 
asymptotics of the stationary distribution. 


3.2 Markov additive kernel and stability 


Recall that the 2d-QBD process is denoted by {{Lin, L 2 n, Jn)',n = 0,1,...}. To dehne the 
1-dimensional QBD process, for i = 1, 2, let Ln'^ = Lin and = {L(^_i)n, Jn), then they 
represent level and background state at time n, respectively. Thus, {(Ln\ > 0} 

is a one-dimensional QBD process for i = 1,2. Denote its transition matrix by For 
example, is given by 


p(i) 


(Lk 


0 




Q? 


0 

0 

0 


q " 

Q? 

0 

0 

0 





v 


\ 


/ 
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where, using (—j) 


+ 




max(0, -j), 


/^((-.)+o) 

4((-i)+i) 

j(-i) 

0 

V ; 


4 ((-i)+o) 

4((-i)++) 

^jO 

4((-i)++) 


A 

A 


0 

((-i)++) 

((-i)++) 

JO 


A 


0 

0 

((-J)++) 

Ji 






^5+°^ 0 0 --A 

A'o A'l 0 

0 A(-i) Ao 


V ; ; ••• ••• ••./ 




We next introduce the Markov additive process by removing the boundary at level 0 of 
the one dimensional QBD process generated by Pd)^ denote its transition probability 
matrix by pd\ That is, 


-A 

0 0 

■■■ 0 gi') gS') 0 ••• 

0 0 g3 gj,'^ gS'^ 

V-. -J 


pd) and gf^’s are similarly defined exchanging the coordinates. For i = 1, 2, let 


gh) = qW + gw + gw^ 


(i) 




then gh) is stochastic. Let = 0,1,...} be the left invariant positive vector 

of g^d -when it exists, where is tuq and m-dimensional vectors for £ = 0 and £ > 1, 
respectively. Define 


glAA 




= e 


gA + Qo^ + eV 


Jn(^) 


i = 1,2. 


In order to discuss the stability of the 2d-QBD process, we dehne the mean drifts /i-*^ 
for each i = 1,2 as 

A*?’ = 

as long as g*^d jg positive recurrent, where the derivative of a matrix function is taken 
entry-wise. Let A = Since A is stochastic and hnite dimensional, it has a 

stationary distribution. We denote it by the row vector Dehne the mean drifts Hi 

and /i2 as 

/ii = y4(_i)fc -|- Aifc)l, /i2 = -|- Aji)l. 

fceH jgh 
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Note that, if yUj < 0, then is positive recurrent because /i* is the mean drift at off- 
boundary states of the QBD process generated by We refer to the recent result due 
to Ozawa 


Lemma 3.1 (Theorem 5.1 and Remark 5.1 of Ozawa jssl) The 2d-QBD process {Zn} 
is positive recurrent if either one of the following three conditions holds. 

(i) If fii < 0 and fi 2 < 0, then < 0 and p® < 0. 

(a) ///ii > 0 and fi 2 < 0, then < 0. 

(Hi) // Pi < 0 and p2 > 0, then pi\ < 0- 

On the other hand, if fii > 0 and p2 > 0, then the 2d-QBD process is transient. Hence, if 
(pi,P2) 7^ 0 , then {Zn} is positive recurrent if and only if one of the conditions (i)-(iii) 
holds. 


Remark 3.1 The stability conditions of this lemma are exactly the same as those of 


the two dimensional reflecting random walk on the lattice quarter plane of lOj], which is 
called a double QBD process in (see also 19]). This is not surprising because the 
stability is generally determined by the mean drifts of so called induced Markov chains, 
which are generated by removing one of the boundary faces. However, its proof requires 
careful mathematical arguments, which have been done by Ozawa 


36 


Throughout the paper, we assume that the 2d-QBD process has a stationary distri¬ 
bution, which is denoted by the row vector tt = {7 r{z, k)] {z, k) G iS}. Lemma l3.ll can 
be used to verify this stability assumption. However, it is not so useful in application 
because the signs of and are hard to get. Thus, we will not use Lemma 13.11 in 
our arguments. We will return to this issue later. 


3.3 Tail asymptotics for the stationary distribution 


Ozawa [3^ studies the tail asymptotics of the stationary distribution of the 2d-QBD 


process in coordinate directions, assuming stability and some additional assumptions. 
His arguments are based on the sufficiency part of Theorem 12.11 As discussed at the end 
of Section [T3l this is intractable for applications. So far, we will consider the problem in a 
different way. In the first part of this section, we derive upper and lower bounds for the tail 
decay rates using relatively easy conditions. We then assume an extra condition similar 
to Assumption 12.11 and derive the tail decay rate of the marginal stationary distribution 
in an arbitrary direction. 


To describe the modeling primitives, we will use the following matrix moment gener- 
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ating functions. 

j,kGM 

= e ^^y4(_i)fc + A^k + e^^^ifc, ^+fc(^i) = ^ofc + k E M, 

4|-’,)(9i) = e-"'+ 4«>, + <t'Vi) = ^+i(9i). *: e H+, 

A[t°\e,) = € H+, 

Similarly, .4j.(02),.4j+(6'2),.4j^‘^t(92),.4y/*(6'2),.4j‘!^'(6'2),.4j.‘^’(02) are defined. Thus, we 
have many matrix moment generating functions, but they are generated by the simple 
rule that subscripts * and + indicate taking the sums for indices in H = {0,±1} and 
{0,1}, respectively. 


Similar to Cq of (12.161) . we dehne the m x m matrix generating functions: 

cW(e) = A.+(e) + yliyi,(«.)(/ - 4r’(9i))-Mir(9i). (3.4) 

ci?(e) = Aue) + 4i|t;j.(e2)(/ - 4°.‘"’(92))-‘4h’(92), (3.5) 

where, for i = 1, 2, Cp{A^^Q{6i)) > 1 is assumed as long as Ci* (0) is used. 

Similar to and of (12.2811 . let, for z = 1, 2, 

rjf = {0E R‘^;3h > 0,A,,{9)h < h,C^}{e)h < h]. 


We further need the following notation. 

= {0e M"; 3h > 0, A,,{0)h < h}, = {0E M"; 30' > 6 , 9 ' E F^^^}. 

Recall that the Perron-Frobenius eigenvalue of y4**(0) is denoted by 'y^^**\9), which is 
hnite because A** (0) is a hnite dimensional matrix. Obviously, we have 

= {0 e < !}• (3-6) 


We now dehne key points for i = 1,2. 

0hF) = arg0gK2 sup{0i > 0; 0 G fJ^ ^}, = arg^^RZ sup{0i; 0 G 

Using these points, we dehne the vector r by 

n = sup{0i G R; 0 G fS+^; 02 < 0?’^^}, rs = sup{02 G R; 0 G Ff+^; 0i < 0^^^}. (3.7) 

Note that r* is hnite because is a bounded set. It is notable that, in the dehnitions 
fl3.7p . the condition that A^,^{9)h < h can be replaced by A^^,{9)h = h or, equivalently, 
^**[9) = 1. 


7 


For z = 1, 2, dehne the function ,^*'*\03_j) for 0 = (0i, 62 ) as 


7^(0 


r(^3-4)=sup{0, GR;0GFSf} for 03 _, G [0, 0f’^']. 




Obviously, is a convex function because is a bounded set. 


As in [18|, ll9j, it is convenient to introduce the following classihcations for r = (ri, 72 )- 
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(Category I) 6 ^ 2 ’^'^ < and for which r = 6'2^’^^). 

(Category II-l) and 6*^’'"^ < for which r = (■^*'^^(^2^’^^); ^2^’'"^)- 

(Category II-2) 62 ^'^^ < 6 ^ 2 ’^^ and for which r = 

fl D (2 D (2 D fl D 

Since it is impossible that 9^ > 9^ and 91 > 91 , these three categories com¬ 

pletely cover the all cases (e.g., see Section 4 of (27|). These categories are crucial in our 
arguments as we shall see Theorem 13.21 below. 

We hrst derive upper bounds. Let (p be the moment generating function of L. Namely, 
p{9) = E(e^'^’^^). Dehne its convergence domain as 

V = {6e 36' > 6, p(6') < cx)}. 

We prove the following lemma in Appendix ID.21 


Lemma 3.2 Under the stability assumption, 

= {0 g rS£; 0 < t} c p. 


(3,8) 


Using this lemma, the following upper bound is obtained. 

Theorem 3.1 Under the stability condition, we have, for each non-zero vector c> 0, 

lim — logP((L, c) > x) < — sup{m > 0; mc G (3.9) 

x^oo X 


This theorem is proved in Appendix ID.31 We next derive lower bounds. We hrst 
consider lower bounds concerning the random walk component in an arbitrary direction. 
For this, we consider the two dimensional random walk modulated by {Ajk]j,k G H}, 
which is denoted by {(T^n, Jn)]n >1}. Similar to Lemma 7 of 19j, we have the following 
fact, which is proved in Appendix [El 


Lemma 3.3 For each non-zero vector c> 0, 

lim inf — logP(L > xc) > — sup{(0, c);0 G T?'^^}, (3.10) 

x^oo X 

and therefore p{d) is infinite for 9 ^ T ^fl , where T ^f^ is the closure o/Tmax- 


Note that the upper bound in fl3.9p is generally larger than the lower bound in (13.101) . 
To get tighter lower bounds, we use the one dimensional QBD formulation. For this, we 
require assumptions similar to Assumption 12.11 


20 


















Assumption 3.1 For each 6 E M? satisfying that = 1, for each i = 1,2, there 

is an mo-dimensional positive vector and functions Cq\0 ) and Ci\0) such that 

either one of Ci\0) or C2^(0) equals one, and 

= c^\e)h^^He), ( 3 . 11 ) 

= c^^\e)h^^**\e), (3.12) 

where *{ik) = *k for i = 1 and *{ik) = k* for i = 2. We recall that h^^**\6) is the 
Perron-Frobenius eigenvector of 


Theorem 3.2 Assume that the 2d-QBD process has a stationary distribution and As- 
sum,ption \S. il Then, we have the following facts for each i = 1,2. For each i > 0 and 
either k E Vi for i = 0 or k eV+ for £ > 1, 

lim — logP(Li > n, L^-t = i, J = k) = —Ti. (3.13) 

n—^oo Tl 

In particular, for Category I satisfying r, < 5)h.max)^ there is a positive constant such 
that 


lim e'^*"P(Li > n, L^_i = i, J = k) = c>^. 

n—>-oo 

Otherwise, for Category Il-i satisfying Ti < , there are positive constants 

such that 


(3.14) 


and d 


-A) 


tk 


lim inf e'^‘”P(Li > n, = i, J = k) > Sfl, (3.15) 

n—^oo 

lim sup e’^*"P(Lj > n, L^^i = i, J = k) < d^^l- (3.16) 

n^oo 


This theorem will be proved in Appendix |Fl Similar results without Assumption 13.11 
are obtained as Theorem 4.1 in j^. However, the method assumes other assumptions 
such as Assumption 3.1 of j^. Furthermore, it requires a large amount of numerical work 
to compute Tj. 

Combining Theorems 13.11 and 13.21 and Lemma 13.3[ we have the following tail asymp¬ 
totics. 

Theorem 3.3 Under the assumptions of Theorem \3.2i we have 

P = F(?'^)^{0eFL“);0<T}. (3.17) 

and, for each non-zero vector c> 0, 

lim — logP((T, c) > x) = — sup{m > 0; mc G V}. (3.18) 

x—^oo X 
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Proof. By Theorem 13.11 we already have the upper bound of the tail probability for 
fl3.18p . To consider the lower bound, let 

Uc = sup{u > 0; MC G T>}, 6{c) = UcC. 

Note that 0(c) < r by Theorem 13.11 We first assume that Oc < t. Then, by Theorem 13.11 
0(c) G and therefore Lemma 13731 leads to 

liminf — logP((ly, c) > x,J = k) > —u^ = — sup{M > 0; nc G V}. (3.19) 

X 

Assume 0c = r. In this case, by Theorem 13.11 we have that [0(c)]i = ri or [0(c)]2 = T 2 , 
equivalently, CiMc = B or C 2 Uc = T 2 - Since these two cases are symmetric, we only consider 
the case for ciUc = Ti. By Theorem 13.21 we have, for each fixed £ and /c. 


liminf — logP(ciLi > n, L 2 = ^, J = k) > -= —Uc- 

n^oo n Cl 

Since ciLi + C 2 L 2 > n for L 2 = i implies that ciLi > n — C 2 i, this yields 


liminf — logP((L, c) > x,J = k) > —Uc = — sup{M > 0; uc G V}. 

n—>-oo n 

Thus, the limit supremum and the limit infimum are identical, and we get (13.18p . □ 


4 Two node generalized Jackson network 

In this section, we consider a continuous time Markov chain {{L(t), J{t))} whose em¬ 
bedded transitions under uniformization constitute a discrete-time 2d-QBD process. We 
refer it as a continuous-time 2d-QBD process. This process is convenient in queueing 
applications because they are often of continuous time. Since the stationary distribution 
is unchanged under uniformization, its tail asymptotics are also unchanged. Thus, it is 
routine to convert the asymptotic results obtained for the discrete-time 2d-QBD process 
to those for {{L{t), J{t))}. We summarize them for convenience of application. 

4.1 Continuous time formulation of a 2d-QBD process 

As discussed above, we define a continuous time 2d-QBD process {(L(f), J(t))} by chang¬ 
ing (or to a transition rate matrix. Denote it by P*^^^ (or P^^^). That is, P^*^ 
has the same block structure as that of P^*^ while P*^*d = 0 and all its diagonal entries 
are not positive. In what follows, continuous time characteristics are indicated by tilde 
except for those concerning the stationary distribution because the stationary distribution 
is unchanged. Among them, it is notable that / — Aqq and / — Aqo are replaced by —Aqq 
and — Aoo, respectively, while A^j and are replaced by and Aij for {i,j) A (0)0). 
Similarly, A**(0) and Cl* (0) are dehned. For example, I — A^q^(6*i) is replaced by 
—A^q^(6*i), and therefore 

c«(0) = 4+(0) + 
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as long as (— 74^o^(6*i)) ^ exists and is nonnegative. C'S){0) is similarly defined. 

Snppose that we start with the continnons time 2d-QBD process with primitive data 
These data mnst satisfy 

i„(0)l = 0, C«(0)1 = 0, * = 1,2, 

because of the continuous time settings. Since the condition for the existence of a su¬ 
perharmonic vector h for is changed to A^,^,{6)h < 0, we define the following 

sets. 

= {6> e m2, ^ < 0}, (4.1) 

e m2; 30' > 0,0' G (4.2) 

fjf = {0eM2;3h>O,i„(0)/i<O,C«(6»)/i<O}, s = l,2. (4.3) 

The following auxiliary notation will be convenient. 

f;j) = {0GM2;3fi>O,i*40)fi = O,C«(0)/i<O}, * = 1,2. (4.4) 

Using these notation, we define 

0^*’^^ = arg0g]K2 sup{6»i > 0; 0 G 0^*’““^ = arg^^RZ sup{6»i; 0 G 

and define the vector r by 

fi = sup{0i G M; 0 G fS+^; 02 < 0?’^^}, r 2 = sup{02 G M; 0 G 0i < 0^^^}. (4.5) 

Remark 4.1 In the definition we can replace vff by because and {0 G 

IK. , C ^}{e)h < 0 } are closed convex sets. 

We also need 


ff = {9efl2(i);e<f}. 

(4.6) 

Let 7"^**(0) be the Perron-Frobenius eigenvalue of 74**(0). A continuous time version of 
Assumption |3.1| is given by 

Assumption 4.1 For each 0 G M2 satisfying that = 1, for each 

is an *7*0-dimensional positive vector li ° (0) and functions Cq ^ (0) and 
one of Co^(0) or c^*^(0) vanishes, and, for * = 1, 

* = 1,2, there 
^(0) such that 

4r(0i)^^'°>) + = c^\e)h^""\e), 

e-^Mi|ii)(0i)^^'°^(0) + i,+ (0i)/i^^">) = cS')(0)/i^^“\0), 

(4.7) 

(4.8) 

and, for * = 2, 


e-®Aji+^02)^^'°^(0) + i+,(02)/*^^**V) = cf)(0)/*^^“V). 

(4.9) 

(4.10) 


~ (A**) ~ 

We recall that h ** (0) is the Perron-Frobenius eigenvector of ^4*^(0). 
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Define the domain for the stationary distribntion of L as 

V = the interior of {6 G < oo}, (4.11) 

where X is a random vector snbject to the stationary distribution of L{t). It is easy to see 
that Theorems 13.11 and 13.31 can be combined and converted into the following continuous 
version. 


Theorem 4.1 For a continuous-time 2d-QBD process satisfying the irreducibility and 
stability conditions, C T> and we have 


lim — logP((T, c) > x) < — sup{m > 0; mc G T,^}, 

X—>00 X 


(4.12) 


and this inequality becomes equality with V = T^ if Assumption \4Fl\ is satisfied. 


4.2 Two node generalized Jackson network with MAP arrivals 
and PH-service time distributions 


As an example of the 2d-QBD process, we consider a two node generalized Jackson net¬ 
work with a MAP arrival process and phase type service time distributions. Obviously, 
this model can be formulated as a 2d-QBD process. We are interested to see how ex¬ 
ogenous arrival processes and service time distributions influence the decay rates. This 
question has been partially answered for the tail decay rates of the marginal distributions 
of tandem queues with stationary or renewal inputs (e.g. see [^, 14|). They basically use 
the technique for sample path large deviations, and no joint distributions has been studied 
for queue lengths at multiple nodes. For Markov modulated arrivals and more general 
network topologies, there is seminal work by Takahashi and his colleagues HQEQ. 
They started with numerical examinations and Anally arrived at upper bounds for the sta¬ 
tionary tail probabilities for the present generalized Jackson network in [l^. The author 
conjectured the tail decay rates of the stationary distribution for a d-node generalized 
Jackson network with d > 2 and renewal arrivals. 


Thus, the question has not yet been satisfactorily answered particularly for a network 
with feedback routes. This motivates us to study the present decay rate problem. As 
we will see, the answer is relatively simple, and naturally generalizes the tandem queue 
case. However, first we have to introduce yet more notation to describe the generalized 
Jackson network. This network has two nodes, which are numbered as 1 and 2. We make 
the following modeling assumptions. 


(0^) A customer which completes service at node i goes to node j with probability rij 
or leaves the network with probability 1 — rij for {i,j) = (1,2) or (2,1), where 
f 12 + ^21 > 0 and ri2r2i < 1, which exclude obvious cases. This routing of customers 
is assumed to be independent of everything else. 

dlb) Exogenous customers arrive at node i subject to the Markovian arrival process with 
generator Ti + Ui, where Ui generates arrivals. Here, Ti and Ui are finite square 
matrices of the same size for each i = 1,2. 
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(jit) Node i has a single server, whose service times are independently and identically 
distributed subject to a phase type distribution with (/3j,S'j), where f3^ is the row 
vector representing the initial phase distribution and Si is a transition rate matrix 
for internal state transitions. Here, Si is a finite square matrix, and /3j has the same 
dimension as that of Si for each i = 1,2. 


Let Di = (—S'jl)/3j, then Si + Di is a generator for a continuous time Markov chain 
which generates completion of service times with rate Di. Since the service time distri¬ 
bution at node i has the phase type distribution with {(3i,Si), its moment generating 
function Qi of is given by 

g,{9) = (/3„ (- 0 J ,+2 - Si)-\-Sa)), ^ = (4.13) 

as long as 6 */j _|_2 -|- Si is non-singular (e.g., see in which the Laplace transform is used 
instead of the moment generating function). Clearly, gi{6) is a increasing function of 6 
from (—cx), 6 *oi) to ( 0 , cxo), where — 6 * 0 * is the Perron-Frobenius eigenvalue of S'*. 

Let Li(t), Jiait) and Jibit) be the number of customers at node i, the background 
state for arrivals and the phase of service in progress, respectively, at time t, where Jibit) 
is undefined if there is no customer in node i at time t. Then, it is not hard to see 
that {{Lit), J{t))-,t > 0} is a continuous-time Markov chain and considered as a 2d-QBD 
process, where L{t) = {Li{t), L 2 {t)) and J{t) = {Jia{t), J 2 a{t), Jib{t), J 2 b{t)), where Jib{t) 
is removed from the components of J{t) if it is undefined. 

We first note the stability condition for this 2d-QBD process. Since, for node i, the 
mean exogenous arrival rate A* and the mean service rate /Zj are given by 

Ai Cjlj) /ij (/^i) ( ^i) hi)) 


where i^i is the stationary distribution of the Markov chain with generator Ti + Ui, it is 
well known that the stability condition is given by 


Ai T ^3—i^(3—i)i 

(1 - ri2r2i)/ii 


i = 1,2. 


(4.14) 


We assume this condition throughout in Section 14.21 

We next introduce point processes to count arriving and departing customers from 
each node. By Nj^°'\t), we denote the number of exogenous arriving customers at node i 
during the time interval [0,t]. Then, it follows from (|1 ]d) (also the comment above fl4.14p j 
that 


= i)| J( 0 ) =j)= [exp(«(ri + e"!/.))]. 


We define a time-average cumulant moment generating function as 

7 (“)( 0 ) = lim -logE(e®^^“^(*)), i = 1 , 2 . 

>-oo t 


(4.15) 


It is not hard to see that 7 h“)( 6 *) is the Perron-Frobenius eigenvalue of Tj -|- e^Ui. 
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By we denote the number of departing customers from node i during the time 

interval [0,t] when the server at node i is always busy in this time interval. Let $*( 77 .) be 
the number of customers who are routed to node 3 — 7 among n customers departing from 
node i. Obviously, it follows from (|3^) that is independent of and has the 

Bernoulli distribution with parameter (n, rj( 3 _j)). Then, 

= fc)|J(0) = j) 

= [exp(t(S'i + e"®‘(rio + , 

where rjo = 1 — 7 ’i( 3 -i)- Similar to -^0 dehne a time-average cumulant moment 

generating function y*^**^^ by 

^h'^)(6>) = lim ilog(*))), 6 = ( 0 i, 02 ), 7 = 1,2. 

t^OO t 

One can see that '^^'^‘^'>(6) is the Perron-Frobenius eigenvalue of S'i+e“®*(rjo+e®®“T 

One may expect that the decay rates for the generalized Jackson network are com¬ 
pletely determined by the cumulants ^( 20 ^ ^( 2 rf) gj]^ 0 g conjugates are known 

to be rate functions for the Cramer type of large deviations. We will show that this is 
indeed the case. Let 

y(+)( 6 )) = 7 ( 1 “) ( 0 i) + 

70 ( 0 ) = +^(20(0^) 1 = 1,2. 

We then have the following result. 

Theorem 4.2 For the generalized Jackson network satisfying conditions 1^) and 
&), if the stability condition holds, then Assumption \4.1\ is satisfied, and we have 

= {0 G < 0}, (4.16) 

f2^ = {0GM^7(+n^)=O,7^*n^)<O}, 7 = 1,2. (4.17) 

Define f and Tf by 
non-zero vector c>0, 

lim — logP((T, c) > x) = — sup{77 > 0; 77 c G f,.}, (4.18) 

x—^oo X 

where L is a random vector subject to the stationary distribution of L{t). 


(4-6), then the domain V for L is given by and, for 


Remark 4.2 As we will show at the end of Section |4.4l the condition that 7^(0) < 0 in 
(I4.17P can be replaced by e“®3-*(r(3_i)o e®T( 3 _j)i) > 1. 


Remark 4.3 For c = (1, 0), (0,1), Katou et ah 1^ obtained the right-hand side of fl4.18l) 
as an upper bound for its left-hand side (see Theorem 4.1 there). Namely, they derived 
the inequality fl4.12p . which is conjectured to be tight in |26| . Theorem 14.21 shows that 
those upper bounds are indeed tight. Based on the results in [l^, Katou et al. 0 derived 
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upper bounds for the decay rate of the probability P(-L = nc + d) for positive vectors 
c, d with integer entries as n oo, and numerically examined their tightness. This 
asymptotic is different from that in fl4.18p . so we can not confirm its tightness by fl4.18ll . 
but conjecture it to be true since similar asymptotics are known for a two dimensional 
semimartingale reflecting Brownian motion (see 0 , 3 )- 


See Figure [2] to see how the domain looks like. 



Figure 2: The domain V for the two node generalized Jackson network 


4.3 Primitive data and matrix moment generation functions 

In this section, we describe transition rate matrices and their moment generating functions 
in terms of the primitive data, Tj, Ui, Si, jSi, of the generalized Jackson network, and prove 
fl4.16p and fl4.17p . They will be used to prove Theorem 14.21 in the next subsection. 

To specify those matrices for the generalized Jackson network, we will use the Kro- 
necker product ® and sum ©, respectively, where © is defined for square matrices A and 
B as 


A® B = h® B, 

where Ji and I2 are the identity matrices with the same sizes as A and B, respectively. 
From this definition, it is easy to see that, if A and B have right eigenvectors and 
with eigenvalues 7^1 and 75 , respectively, then 

{A © B){hA © hs) = {'lA + 'lB){hA © hB). (4.19) 

We also will use this computation. 

For transitions around the origin, we let 

=Ti® T2, = f/i © /2 © /3i, © ^2 © /32, 

= /l © /2 © = h®l2® D 2 I, 
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where other not specihed above are all null matrices. This convention for null 

matrices is used for all transition matrices. Around W+o UW+i, that is, the 1st coordinate 
half axis except for the origin, 

® ^2 ® (r-ioA) aS=Ti©T2©^i, = f/i ©/2 © Is, 

= /i O /2 ® {ri2Di) © (32 iff = h®U2®h® P 2 , 
iff_i) = h®l2®h® (r2oA>2l), i[ffi) = Ii®h®h® {r2iD2l). 

Similarly, around Wo+ UWi+, that is, the 2nd coordinate half axis except for the origin, 

A^0(-1)= Ii^l2®{r2oD2), iff=Ti©T2©^2, iff = /l © 172 ® /4, 
ilffi) = /i © /2 «) /3i © (r2iT>2), iff = Ui^ (3^® h, 
i(ff )0 = 7i © /2 © (rioT>il) © /, iff\)i = /i © /2 © (ri 2 T>il) © h- 
For transitions within W+, that is, the interior, 

ioo = 7 i © r2 © S*! © S2, iio = Ui ® I2 ® I2 ® 73, ioi = Ii ® U2 ® I3 ® Iai 
i(-i)o = 7 i © J2 © (rioTli) © J4, i(-i)i = 7 i © J2 © (ri2lli) © I4,, 
io(-i) = 7 i © J2 © Is © (^20712), ii(-i) = 7 i © 72 © 73 © (r 2 i 7 l 2 ). 

Thus, we have 


i„( 6 >) = (Ti + © (T 2 + e^^U2) 

© (Fi + (e-^Vio + e-"i+''Vi 2 ) 71 i) © {S2 + {e-^^r 2 o + 21)02). 

Recall that 77 “^( 0 j) is the Perron-Frobenius eigenvalue of Ti + We denote its 

eigenvector by (^Oi). Similarly, we denote the Perron-Frobenius eigenvalues and vectors 
of Si + (e“®irio + e~^^~^^'^ri 2 )Di and S 2 + {e~^'^r 2 o + e^^~^^r 2 i)D 2 by 


and h^^^\0) and hS^'^\0), respectively. That is, they satisfy 

(Ti + e^^Ui)h^^^\ei) = (4.20) 

(T 2 + e^^U2)h^‘^^\d2) = l^‘^°‘\e2)hP"\e2), (4.21) 

(Fi + (e-^Vio + e-^^^^^ri2)Di)h^^^\e) = , (4.22) 

(^2 + (e-®V 2 o + e^^-^^r2i)D2)h^^''\6) = . (4.23) 


Thus, recalling 7 *^"'■1(0) and letting 

/i(+)(6>) = h^^‘^\ei) © fi(2“H02)«) h^^‘^\e) © h^‘^’^\e), 

we have, by repeatedly applying fl4.19l) . 

i„(6>)fiW(6>) = 7W(6>)fiW(6/). 

Hence, recalling the dehnition fl4.ip of we have 04.161) . 








We next note that can also be obtained from the moment generating function gi 
of service time distribution at node i. For i = 1, 2, let 

ti{e) = e"®*rio + 

then it follows from fl4.22l) and fl4.23p that 

since Dih^^'^\6) = (/3j, S'*!). Hence, premultiplying —5'*)“^, we have 

Let us normalize [0) in such a way that 

(4.24) 

then we have the following facts since gi is nondecreasing. 


Lemma 4.1 Fori = 1,2, (a) under the normalization ^.24\ ), 

= (7(*'')(6»)J - (4.25) 

and therefore gi{—'y^^‘^\0)) = ti{0)~^, which yields 7 *^*'^)( 0 ) = —g~^{ti{0)"^), 

(b) 7 h'^)( 0 ) > 0 z/ and only ifti{0) > 1, which is equivalent to 

Fo + e®3-Vj(3_i) > e®\ (4.26) 

(c) If Ui = {—Til)a.i for probability vectors cxi, that is, the arrival process at node i is 
the renewal process with interarrival distribution determined by the moment generating 
function: 

f^{e,) = {(Xi,{-eii -T,)-\-T,i)), 
then 7 ^*“^( 0 i) = —f^^{e~^*)- 


Remark 4.4 

0 )- 


(a) and (c) are known (see, e.g.. Proposition 2 of [39 


and Lemma 4.1 of 


4.4 Proof of Theorem 14.2 

We first verify Assumption 14.11 for i = 1 and c^i\0) = 0, Namely, for 6 ^ Mf satisfying 
that 7 ’^'''^( 0 ) = 0, that is, 

7^1“) (0i) + 7^2“) (02) + 7^"''^ {0) + 7^^'"^ (0) = 0, (4.27) 

we show that there are some Co^^(0) and h^^^\0) > 0 such that 

+ e^^A^^,\e,)h^-^\0) = A^\0)h^^^\0), (4.28) 

e-®^iy_^)(0i)/i(°i)(0) + A,o{Oi)h^^\0) + e^M,i(0i)h(+)(0) = 0, (4.29) 
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where 


A^,J^[ 6 ) = (Ti + e^^Ui) © (T2 + 6^^112) © (S*! + (e ^^Tiq + e © <S'2, 

A*(_i)( 0 i) = Ji © /2 © /s ( 2 ) {{r20 + f' 2ie^^)-D2), 

^1(Li)(6'i) = /l © /2 © -^3 © ((^"20 + ’"2ie^^)-D2l), 

^lo^(^i) ~ (^1 + © T 2 © {Si + rioe 

4lVi) = A © (t /2 © (ri2e-^i A)) © f3^. 

We further require the non-singularity condition: 

<0. (4.30) 

From (I4.28p . this holds if c^\6) < 0. 

Since A^^{6)h^'^\6) = 0 by 04.271) . 04.29P is equivalent to 

A^^_,^{ei)h^^^\9) - A^_iAei)h^^\e) = o. (4.3i) 

Note that y4*(_i)(0i) and have a similar form, so we let 

and guess that, for some scalar a{6), 

h(°^)(6l) = a{9)h^^\9). 

We first verify 04.281) . Since 

= a{9){'j^^'^\ei)h^^\9) + h^^^\ei) © (T2/r(2“)) © h^^‘^\9) 

+ © h^^'^\e2) © (^1 + rioe-^Wi)h^^’^\9)), 

© (e^^U2h''^°‘\e2) © h^^'^\9) 

+ /i(2“)(02) © {ri2e-^^+^^Dih^^^\9))^ {(3^, h^^'^\9)), 

we choose a{9) = (/32, ^,^^'^^(0)), which is t2{9)~^ by 04.24p . then 

Hence, we have 04.28P with 

= 7(i“)(0O +7^'“n^2) 

We next consider 04.3ip . Recall that D 2 = (—S'2l)/32- Since 

= h^^^\9) © ((r2oe-®= +r2ie®i-^=)(/32,^^“n^))^2l)), 
e-^^A,^_iAei)h^+\9) = h^'^^\9) © {{r2oe-^^+r2ie^^-^AD2h^‘"'\0)), 

D2h^^^\9) = {-S2l){f32,h^"‘'\0)) = {I32,h^^^\9)){-S2l) = (/32, 
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we have (14.311) . Thus, we have verihed Assumption 14.11 and therefore 6 E is equiv¬ 
alent to = 0 and < 0. Because arguments are symmetric for nodes 1 and 

2, we can get similar results for node 2. Thus, Theorem 14.21 follows from Theorem 14.11 
because of Remark 14.11 

We hnally note that, for 0 G satisfying 7 ‘^+)( 0 ) = 0, < 0 is equivalent to 

7 h'^)( 0 ) > 0, which further is equivalent to 04.261) . Hence, we have verihed the claim in 
Remark 14.21 


5 Concluding remarks 


We have studied the existence of a superharmonic vector for a nonnegative matrix with 
QBD block structure. We saw how this existence is useful for studying the tail asymptotics 
of the stationary distribution of a Markov modulated two dimensional rehecting random 
walk, called the 2d-QBD process. We have assumed that all blocks of the nonnegative 
matrix are hnite dimensional. This is a crucial assumption, but we need to remove it 
for studying a higher dimensional rehecting random walk. This is a challenging problem. 
Probably, further structure is needed for the background process. For example, we may 
assume that each block matrix has again QBD block structure, which is satished by a 
rehecting random walk in any number of dimensions with Markov modulation. We think 
research in this direction would be useful. 


Another issue is about the tail asymptotics for a generalized Jackson network. We 
have considered the two node case. In this case, the tail decay rates are determined 
by time average cumulant moment generating functions, 7 ^“^ and 7 ^^^^ by Theorem 14.21 
This suggests that more general arrival processes and more general routing mechanisms 
may lead to the decay rates in the same way. Some related issues have been recently 
considered for a single server queue in Section 2.4 of 0 , but the network case has not 
yet been studied. So, it is also an open problem. 


In a similar fashion, we may be able to consider a generalized Jackson network with 
more than two nodes. To make the problem specihc, let us consider the k node cases for 
k >2. Let iP = {1, 2,..., /c}, and let 


k 

i=i 


Then, the sets similar to for k = 2 may be indexed by a non-empty subset A of K, 
and given by 

= [0e M^ 7 (+)( 6 l) = O,7W(0) > 0,Vi e JF\ A} . 

These together with = {0 G M^; 7 A) {0) < 0 } would play the same role as in the two 
dimensional case. That is, they would characterize the tail decay rates of the stationary 
distribution. We may generate those sets from 

= {0 G M^7(+n^) = 0,7^*n^) > 0} , ieK. 
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Thus, the characterization may be much simpler than that for a general k dimensional 
random walk with Markov modulation. However, we do not know how to derive the decay 
rates from them for k > 3 except for tandem type models under some simple situations 
(e.g., see S0)- This remains as a very challenging problem (e.g., see Section 6 of (^). 


We hnally remark on the continuity of the decay rate for a sequence of the two node 
generalized Jackson networks which weakly converges to the two dimensional SRBM in 
heavy traffic. Under suitable scaling and appropriate conditions, such convergence is 
known not only for their processes but for their stationary distributions (see, e.g, p, ll3|). 
Since the tail decay rates are known for this SRBM (see 0), we can check whether the 


decay rate also converges to that of the SRBM. This topic is considered in [30 


Appendix 


A Proof of Lemma 12.3 


(a) For sufficiency, we assume that F^*^^ ^ 0, that is, there is a 6^ G F^'^\ For this 6, 
let y = {yi,y 2 ,.. .y for then it is easy to see that Kj^y < y, and 

therefore Cp(iF+) > 1. For necessity, we use the same idea as in the proof of Theorem 
3.1 of j^. Assume the contrary that F^*^^ = 0, which is equivalent to min^ > 1, 

when Cp(iF+) > 1 holds, and leads a contradiction. By this supposition and the convexity 
of there is a 9o such that 7^'^*^(6*o) > 1 and (7*''^*^)'(0o) = 0. 

We next define the stochastic matrix whose {k, i) block matrix is given by 

[ > l,^ > 0, I*: - f| < 1, 

d?’ =l I, k = i = 0, (A.l) 

I 0, otherwise. 

Since 7^"^*^(6*o) > 1 > 0, this stochastic matrix is well defined. The Markov chain 
with this transition matrix is a Markov modulated random walk on Z+ with an absorb¬ 
ing state at block 0, where is the transition probability matrix of the 

background process as long as the random walk part is away from the origin. Denote its 
stationary distribution by That is, 

^(9o)^{eo) ^ 


which is equivalent to 

Taking the derivatives of Ay6)h^'^*\9) = y^*\9)h'^^*\9) aX 9 = 9o, we have 

A:(9o)h(^^H0o) + Ay9o)(h(^^y(9o) = 7^^*n^o)(^^^*^)'(^o) + (7^^‘^)'(^o)^^^*H^o). 

Multiplying by ^ from the left, we have 


TT 


(^* 0)^-1 




(-e — (7^^*^)'(6*o). 


(A.2) 
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The left side of this equation is the mean drift of the Markov modulated random walk. 
Since = 0; this drift vanishes, and therefore the random walk hits one level 

below with probability one. 

Since we have assumed that Cp(K+) > 1 , has a superharmonic Let = 
(y^, y^,.. .)^ be a superharmonic vector of iL+, and let 

gm ^ n > O. (A.3) 

We then rewrite fl2.8p as 

< gi"”’. n>L (A.4) 

£= 0,±1 

/(n\)o(^o) be the probability that the Markov chain with transition matrix is 

absorbed at block 0 at time £ given that it starts at state (n,i), and denote the vector 
whose i-th entry is by Dehne its generating function as 

OO 

/io(w,^o) = ^V^fnd(^o)- (A.5) 

£=1 

Assume that ^ 1 (^ 0 ) ^ 1) which is equivalent to 

y+ > h^^*\9o). (A. 6 ) 

We can always take h^^*\6o) satisfying this condition because the vectors are hnite di¬ 
mensional and constant multiplication does not change the eigenvalue. Since is 

7 ( 0 o)-superharmonic by flA.4p . it follows from the right-invariant version of Lemma 4.1 of 
Vere-Jones [i^ that 

n>l. (A.7) 

However, the random walk is null recurrent. Hence, /*q(1;6'o) = 1. This implies that 
= 00 because 6 * 0 ) = 00 and > 1 , which implies that 

y^°'^ = OO. This and flA. 6 D conclude that y^ = 00 , which contradicts the fact that y^ is 
superharmonic for K+. Thus, we must have that mine 7 ^^*^( 6 *) < 1- 
(b) It follows from (a) that Cp{uK^) > 1 if and only if u'y'^*{9) < 1 for some 0 G M. By 
fl2.3p . Cp(A'+) > M if and only if Cp{uK^) > 1. Hence, 

Cp(A+) = sup{m > 0; 30 G M, M7'^*(0) < 1} = (minyAdj^^^^-i^ 

9 

This proves (b). We remark that the finiteness of m is crucial for flA.6D to hold. 


B Proof of Lemma 12.4 


Since Tq^^ is a subset of T^'^^ PiTq^'^^ it is bounded. For the convexity, we apply the same 
method that was used to prove Lemma 3.7 of 32|. For 0i,02 £ there exist positive 
vectors h,b)(0) and h^‘^\9) such that, for i = 1,2, 

A,{9i)h^^\9) < a(0i)h«(0) < hb)(0). 
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Choose an arbitrary number A G (0,1). Let g be the vector whose j-th entry gj is given 
by 


9, = {hf)\hfy 


j = l,2,...,m. 


Then, using Holder’s inequality similarly to the proof of Lemma 3.7 of [32 
that 


we can show 


A^,{X9i + (1 — \)92)g < g, C'*(A6*i + (1 — X)92)g < g. 

This proves that X9i + (1 — A) 6*2 G Tq^^ Thus, Tq^^ is a convex set, and therefore it is a 
hnite interval. 

It remains to prove that Tq^^ is a closed set. To see this, let 9^ be an increasing 
sequence converging to 9^^^^. Then, we can find hn for each 9n such that fl2.24p and 
fl2.25p hold for h = hn and 9 = 9n and it is normalized so that h^l = 1 , where 1 is 
the column vector whose entries are all units. Since hn is normalized, we can further 
find a subsequence of {hn} which converges to some finite h^o > 0 as n —)> oo. Since 9n 
converges to 0max as n —)■ oo, we have fl2.24p and fl2.25p for h^o and 0max, which in turn 
imply that h^o > 0 by the irreducibility of A^{9). Hence, ^max £ Similarly, we can 

prove 9mm e Thus, ^max]- 


C A counter example 


We produce an example such that AiG- ^ e^Hi for any 6 ^ 7 ^ 0 for m = 2. For p,q,r, s > 0 
such that p + q + r < 1, 2p + q < 1 and s < 1 , define two dimensional matrices Ai as 

^ 0 ^ A - f 0 l-(p + q + r) \ _ f p q 

Is 1-s loo 


A-i — 


Since A = H_i + Aq + Ai has the stationary measure (s, 1 — (p + r)), the Markov additive 
process with kernel {Ap, i = 0, ±1} has a negative drift by the condition that 2p + g < 1. 
Hence G_ must be stochastic. Furthermore, the background state must be 1 after the 
level is one down because the second column of A_i vanishes. Hence, 


G_ = 


and therefore 


AiG- = 


p + q 
0 




n 

e p 


n 

eg 


0 0 


= e%. 


D Proofs for the upper bounds 

In this section, we prove Lemma 13.21 and Theorem 13.11 To this end, we formulate the 
2d-QBD process {Zn} as a Markov modulated reflecting random walk on the quarter 
lattice plane, and consider the stationary equation for this random walk using moment 
generating functions. Similarly to the one dimensional QBD processes in Section [21 we 
first derive a canonical form for the stationary equations. This canonical form simplihes 
transitions around the boundary similar to the QBD case. 
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D.l The stationary equation and inequality in canonical form 

Assume that {Zn} has the stationary distribution tt. Let 

L e J = k), keV+,w = +,++, 
e U^, J = k), kEVi,w = l, +0, +1, 

eU^,J = k), fc e V 2 , u; = 2, 0+, 1+, 

where Z = {L, J) is a random vector subject to tt. We denote the vectors whose fc-th entry 
is (p^j^\6) and respectively by cp^'^\0) and cp^'^\9i). Similarly, 7r(h j) denotes the 

vectors for the stationary probabilities 7r{i,j, k). 

Lemma D.l If (p(0) is hnite, then 
¥^(++)(6>)(/-A,,(0)) 

+ = 0, (D.l) 

where 

= e®i+^^7r(l, 1 )(/ - aV°|(0 )) 

- (7r(l, 0)AilJ (0i) + e^=7r(0, l)Ag(02) + 7r(0)AS)) 

in which and are dehned as 

^W( 0 i) = + 7 r(l,O)(A^^J( 0 i) - J) + 7 r( 0 ,l)A®_^) + 7 r( 0 )A®), 

V^(2^(02) = 6 ^ 2 ( 77 ( 1 , + 7r(0, 1)(A[,5(^2) -I) + 7r(l,0)Aj°\)^ + 7r(0)A®). 

Remark D.l (ID.ip reduces the stationary equations to those for the 2d-QBD whose 
random walk component is on Uj^. Obviously, all the complexities are pushed into Ol* {0) 
and 

Proof. Assume that Zq has the stationary distribution tt, then Zn+i = {Ln+i, Jn+i) 
and Zn = {Ln, Jn) have the same distribution tt. Hence, recalling that El = {0,1, —1} 
and taking the moment generating functions of fl3.3l) for = fc G V+, we have 

A'(»)= E E e"‘+>»^e»‘+''>7r(l,l,fc')l^«]« 

k'GVj^ i,jGM 

2eiH[,jeiH[+ igh+j'gh 

fc'GVi iGH iGBI+ 

k'&V2 jgh ieH+ 

+ ^ e^i+^=7r(0,0,fc')[ASy,fc, (D.2) 

fc'GVo 
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1, 2 exist and are finite for all k. Similarly, it 


as long as and for w = 

follows from fl3.3p that, for fc G Vi, 

+ e'^'7r(l,0,/c) 

fc'eV+ igH iGH+ 

+ X (X^"^Vfc^°H^l)[A'0^]fc'fc + X 0) ^0[A'O^]fc'fc) 

fc'gVi igH iGBI+ 

+ X (e'^-'^e^V(O,l,fc0[4(L)]A.'fc + e'^^(O>O>^0[4o]fc'^^ (D-3) 

fc'GVo 

and (pf^\92) for /c e V 2 is symmetric to for k G Vi. 

Recalling the matrix notation, Aj+( 6 * 2 ), A^j( 6 *i), ^^^^( 6 * 2 ) and the vector 

notation for w = +,++ and Lp^'^'\0i) for w' = l,+0,+1 and £ = 1 and for 

w' = 2, 0+, 1+ and ^ = 2, the stationary equation flD.2p can be written as 

(^(+)(0) = (^(++)(6»)^*(0) + e®i+'^27r(l, l)2l++(0) 

+ e^\Lp^+^\eM*+{0) + <^(+°)(^i)41Vi)) 

+ + ¥^(°+)(^ 2 )AS*V 2 )) 

+ e''i7r(l, O)XJ(^i) + e''^^(0, l)2lS5(^2) + e^^+^^7T{0)Afl (D.4) 


as long as ^{0) is hnite, where ^{6) is the V+-dimensional vector whose k-th entry is 
ipki.0)- Similarly, flD.3p yields 


(^(+0) 

(^ 1 ) 

1 + 

(1.0) = 

=cp(+i)(0o4;L)(^i) + 4+°n0i)440i 

) + eO'Tr)!, ljA[l 

-1,(9.) 





+ (7r(l, O)A4(0 i) + 7r(0, 

+ '"■(0)4?). 

(D.5) 

and by 

symmetry. 






(02: 

) + e^^TT 

(0,1) = 

=(^(i+)(02)4lj!.\),(02) + c^(°+H0')4?(02 

)+£.''-70(1,1)44,qoo) 





+ (7r(0, 1 )Ao 402 ) + 7^(1, 

+ 7r(0)A[,?), 

(D,6) 

and 









7r(0) = 

7r(0)A 

m + 7r(0, 7r(l, -h ti 

■(1; l)^(_\)(_i)- 

(D.7) 


Obviously, the equations flD.4p - flD.7p constitute the full set of the stationary equations, 
and therefore they uniquely determine the stationary distribution tt because of the irre- 
ducibility. 

Assume that / — / — Ag4^2) are invertible and recall the dehnitions of 

and '0^^^(6*2), then we can get, from fID.Sp and flD.6D . 

v<+“>(«i) = (v’‘+‘>(«i)4!’-i)(»i)+’/’“>(«!))(/ -ho (D. 8 ) 

V<“+>(»2) = (h‘+>(«2)h-l).(»2) + h"'(»2))(/ - h?(«2))-^ (D,9) 
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Substituting these and into flD.4p and using the vector version of 

(lEl: 

+ e®i+®"7r(l, 1), 


we have 


^(++>(e){i - A..{e)) 

+ e^v'^” W)(/ - (A+(e) + A™ .,(»i)(^ - 4h»i))-‘^lh»i))) 

+ e''v“*’(«2)(/ - (^+.(e) + <’i,.(«2)(/ - 4?(»2))-‘^f.’(»2))) + V>‘“>(e) 

Recalling the dehnitions of this yields fID.ip . 


0 . 


□ 


D.2 Proof of Lemma 13.2 


In Lemma [P. 11 we have assumed that the moment generating functions for the stationary 
distribution are hnite. We can not use this hniteness to prove Lemma 13.21 Nevertheless, 
Lemma [D. II is useful in the proof of Lemma [3.21 This is because we will use its inequality 
version und^ some extra conditions in a similar way to Lemma 4 of Kobayashi and 
Miyazawa 


19| . A key idea is the following lemma. 


Lemma D.2 Assume that 0 G satisfies one of the following conditions. 

(a) 0 G and |(^"'(0)| < oo for w = +1,1+, 

(b) 0 e and < oo, 

(c) 6 G and < oo, 


where |a| = Yhi 1^*1 vector a whose i-th entry is Oj. Then, 

^(++)(0)(/_yl„(6>)) 

+ +e''V^'+n^2)(/-C'(2)(0)) +tA(o)(0) <0, (D.IO) 

and therefore 6 eTA. 


This lemma is slightly different from Lemma 4 of [l9j because we here have background 
states. However, we can apply the exactly same arguments to derive fID.lOD from the 
one step transition relation 03.31) for each hxed background state under the stationary 
distribution. Hence, < h {C't}{6)h < h) and 




(++)(0)(/ - < oo, - C't}{0))h < oo). 


where tc(l) = +1 and w{2) = 1 +, implies that < oo (|c^h+)( 0 )| < qq, respec¬ 

tively). This completes the proof of Lemma [D.21 

Similar to the proof of Theorem 1 of [l^ (see Section 4.3 there), it is not hard to see 
that Lemma [D.2I yields Lemma [3.21 
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D.3 The proof of Theorem 13.1 


For each m, a; > 0, we have, for uc G 

e“^P((X,c) >x)< E{e^^’^^h{{L,c) > x)) < ip{uc). 
Taking logarithm of both sides of this inequality, we get 

u + — logP((T, c) > x) < — log ip(uc). 

X X 

This yields 


limsup — logP((-L, c) > x) < —u 

X^OO X 


as long as uc G and therefore 

lim sup — log E{{L, c) > x,J = k) 

X^OO ^ 

< limsup — logP((X, c) > x) < — sup{m > 0; mc G 

X^OO ^ 


E The proof of Lemma 13.3 


Similar to Lemma 4.2 of [19|], we can apply the permutation arguments in Lemma 5.6 of 
twice. For this, we use a Markov modulated two dimensional random walk {{Yn, Jn)}, 
whose increments = Yn+i — Yn have the following conditional distribution. 


(-^n+l ^1 Jn+1 j I Jn i') 


U\IJ 


u G i,j G V+. 


We here recall that El = {0, ±1}. For each n > 1, we permute the Markov modulated ran¬ 
dom walk {{Yi, Ji)^i = 0,1 ,... ,n} starting with l^o = 0, and dehne {{Y^^\ = 

0 ,1 ,..., n} for m = 1, 2,..., n as 


Y^^'^ = 0 , Yr’ = X 

n—m+l 


(m) 


m+li 




m+l 


+ x 


m+2) 


_ V 

-* n—m ^m+l “T 




— Xm+1 Xn + Xi, 


= X^+i + ... + x„ + Xi + X2 +... + 

^(m) r Jm+i-i ^ 0 , 1 , . . . , Tl 

^ \ Ji-^n-m), £ = n - m + 1 ,..., n. 


Obviously, {iY^^\ = 0,1 ,..., n} and = Jm = for m = 1,2, ...,n 

have the same joint distribution for all m under the probability measure in which {Jn} 
is stationary. We denote this probability measure by Pjy_^, where z/+ is the stationary 
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distribution of the background process {Jn}- We next consider the following event for 
n > 1, 1 < m < n, as > 0, j G V+ and B G 

E+{n, m,B) = { min > 0, min > 0, Y^^'> eB,Jo = Jn}, 

l<£<n ^ l<e<n ^ 

E^in, m,B) = { min ^ > 0, G 5, Jq = JJ. 

l<i<n 

Then, we have 

^}n=i E+ij^, m, B) D E 2 {n, M, B), for some M G {1, 2,..., n}, 

U" E 2 {n, m', B) D {F„ eB,Jo = Jn}, 

where M may be chosen so that Y^^'^ for m = 0,1,..., n attains the minimum at m = M. 

Since -E+(n, m, B) has the same probability for any m under and similarly E 2 {n, m', B) 
does so, we have 


Pi. ( min Ya > 0, min Y^ > 0, F„ G 

l<i<n l<e<n 


B, Jn 


Jo) 


> -Pi.+ ( min Yi 2 > 0, G B, Jn = Jq) 

n ^ l<i<n 

> —Pj.^(F„ G-B, Jn = Jo, Fq = 0). (E.l) 


We next note the Markov modulated version of the well known Cramer’s theorem 
Theorem 1 of 33|). For this, dehne the Fenchel-Legendre transform of log7^"^**^(0) 


(see 

as 


A*(a3) = sup{(0,a;) — log 7 ^'^**^( 0 )}, 

6»eM2 


then we have, for any open set G in M^, 

liminf — logF(F„ G riG, Jn = j| Jo = *) > b j ^ 1^+, z E G. 

n—^oo n 


(E.2) 


Let iS++ = W++ X V+, and let uo = inf{£ > 1; G iS \ 5++}. Since the random walk 
{(F^, J()} is stochastically identical with {(T^, J^)} as long as they are in iS++, we have, 
for y G and G such that G + z C G for each z G , 


Pn+(Tn e nG, (To > n, Jn = Jo|To = y) 

= Pi.^ (Yn e nG - y,ao > n, Jn = Jo) 

> —Pj. (Fn G nG, Jn = Jq)- (E-3) 

n^ 

Recall that n = {i/(z, j); (z, i) G 5} denotes the stationary distribution. For Zq = 
(2,2), let 


d = min i^(zo, i), 
iev+ 


39 




then d > 0 since {{Li, Jg)} is irreducible and V+ is a finite set. Denote the normalized 
distribution of vr restricted on 5 \ 5++ by ttq, and denote the probability measure for 
{{Lg, Jg)} with the initial distribution tto by Pttq. Let 

G = {0 G > c}, 


which satisfies the requirement of flE.Sp . Then, it follows from the occupation measure 
representation of the stationary distribution and flE.lIl with B = G that, for any m, n > 1, 
i G V+ and Zq = (2, 2) G 5++, 


L G nG) — ———- P7rp(2v£ G nG, (Tq > 


> 


^*77(^0) 
1 


Eixis^o) 

P7ro(-^m ^ TlG, Jra dg, Cq ^ TTl, Lq ^q) 


> Try—t ^u+{Lm - Loe nG, = Jo,cro > m\Lo = Zq, Jq = i)7ro(zoD) 

^77(0-0) 


iev+ 


d 


— Z7' ^ ^ 'j 1?!^+ .Lq G nG, Jm Jqt ^0 ^ >-^0 f | Eq 

U/TrlO'oj . 


iev+ 


> 


d 


-Pj /1 G nG, Jm do,(TQ > ?T7.| ZvQ -^o) 


> 


rP77+(T^m ^ nG, J^n dg, (Jg > 7T7.) 
^'K 1^0 j 

d 


> 


m?E^{ao) 
d 


IPj7+(^m £ Jm — dg) 


m?E{aQ) 


¥{Ym G nG, Jm = j\Jo = J>+(i)> 


where we have used the facts that the distribution of {{Lg, Jg)} is unchanged under 
the conditional probability measures P,ro and P^^ given (Tg,dg), and similarly {Yg} is 
unchanged for P^^ and P given dg. 

Since x G nG is equivalent to a; > c, taking logarithms for both sides of the above 
inequality and letting m, n —)■ cxo in such a way that n/m —)■ f for each fixed f > 0, flE.2D 
yields 


1 


m 1 


lim inf — log P(T > nc) > lim-log P ( Ym > ni —c, d^ = j 


n—^oo fi 


n^oo n m 

> -G'itc) 


n 


m 


dg = j 


Since f > 0 can be arbitrary, this implies that 


1 

lim inf — logP(L > xc) > — inf -A(tc) = — sup{(0, c)-,6e 

3;->-oo X i>0 t 


where the last equality is obtained from Theorem 1 of (see also Theorem 13.5 of [37|). 

It remains to prove that 6 ^ r^ax implies = oo, but its proof is exactly the same 
as that of Lemma 4.2 of 1^ except for a minor modification. So, we omit it. 
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F One dimensional QBD and lower bounds 


In this section, we prove Theorem 13.21 For this, we apply the Markov additive approach 
given in Section 5.5 of 2^. This am 
the same as that of Miyazawa [21 


)roach is also taken by Ozawa [3^, which is essentially 
|. We first formulate the 2d-QBD process as a 1- 
dimensional QBD process with inhnitely many background states, taking one of the half 
coordinate axis of the lattice quarter plane as level. There are two such QBD processes. 
Since they are symmetric, we mainly consider the case that the first coordinate is taken as 
level. Our arguments are parallel to those of Ozawa 3q, but answers are more tractable 
because of Theorem 12.21 


F.l Convergence parameter of the rate matrix 

We hrst consider the convergence parameters of the so called rate matrix of the one 
dimensional QBD process {{Ln \ for s = 1,2. This is dehned as the minimal 

nonnegative solution of the matrix quadratic equation: 

Since arguments are symmetric for s = 1 and s = 2, we will mainly consider the case for 
s = 1. As is well known, the stationary distribution of is given by 

n>l, (F.l) 

where TVn^ = k)] k eVi for j = 0, /c G V+ for j > 1}. Then, we can see that the 

reciprocal of the convergence parameter CpfP^^Q gives a lower bound for the decay rate 
of 7r^^^(n, j, k) for each hxed j, k (e.g., see [2^ for details). 


As shown in [2^, this convergence parameter problem can be reduced to hnd the right 
(or left) sub-invariant vector of the matrix moment generating function q1 ^^(6 'i) by the 
Wiener-Hopf factorization for the Markov additive process with transition matrix P*-^^. 

Recall that 


qS‘>(«i) = 




0 

0 

0 

...\ 

4 ib,( 9 .) 

^*o(^l) 

A*i(0i) 

0 

0 


0 

A*(_i) (^i) 

A^o( 9 i) 

A*i(6*i) 

0 


0 

0 

^*(-1) (^i) 

A*o(^i) 

^*1(6^1) 


v 





...j 


Let 

c'loVi) = (^i))-'41Vi) + ^o(^i), 

and dehne the canonical form of q1 ^^(0 i) as 

( A*i(0i) 0 0 0 

A*(_i)(6*i) A*o(6*i) A*i(6*i) 0 0 

0 A*(_i)(0i) A*o(6*i) ^*i(^i) 0 

0 0 A*(_i)(6*i) A*o(6*i) A^i{9i] 

V ; ; 


(F.2) 


Qi'\0i) = 


...\ 


...J 
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Similarly, Qf\ 62 ) is defined. It is easy to see that is stochastic for s = 1,2. 

Thus, Q* {9s) is a nonnegative matrix with QBD block structure, and therefore we 
can apply Theorem 12.21 For this, we note the following fact. 

Lemma F.l For s = i,2, rif is a nonempty and bounded convex subset o/M^. 

This lemma is proved similarly to Lemma fFM using the fact that 0 G T^^^ for s = 1, 2. 
The following result is immediate from Theorem 12.21 


Lemma F.2 Under the assumptions of Theorem \3.2l Q^^\ 6 i), equivalently, q[^\0i), has 
a superharmonic vector for each 6^1 G M z/ and only if the following two conditions hold. 

(^) cp(4iVi)) > 1- 

(a) There exists 062 such that 6 = (6^1, 6^2) G T^^^ equivalently, 9 G vff’. 

By symmetry, a similar characterization holds for q 1^^(6*2). 

It follows from this lemma and the Wiener-Hopf factorization that, for s = 1, 2, 

logc,(i?(^)) = snpiOs > 0;c,{Qi'\es)) > 1} = 0^^), (F.3) 

as long as > 1. We are now ready to accomplish our main task. 


F.2 The proof of Theorem 13.2 


From (IF.ID . (IF.3P and Caucy-Hadamard inequality (e.g., see Theorem 14.8 of Volume I 
of 2^), we have the following lower bound. 


liminf — logP(Ls > n, L^_s = i, J = k) > s = 1, 2. 

n—>-oo fl 


(F.4) 


m 


By Lemma 13.31 this lower bound is tight if ^(s.max) ^ ^ 

Thus, it remains to consider the case that this case, it follows from 

Theorem 12.21 and Lemma [T5l that is 1-positive, which is equivalent to the fact 

that 0 ^“ ’ is 1-positive by the Wiener-Hopf factorization. We consider Categories (I) 
and (II-l), separately, for s = 1. This is sufficient for the proof because Category (II-2) 
is symmetric to Category (II-l). 

Assume that the 2d-QBD process is in Category (I) and that in 

this case Tg = for s = 1,2. Hence, flF.4p implies fl3.13p . To prove fl3.14D . we apply 


Theorem 4.1 of Slj (see also Theorem 2.1 of 2^ or Proposition 3.1 of (27|). For this. 


we consider the left and right nonnegative invariant vectors of which is a 

nonnegative matrix with QBD structure and unit convergence parameter. 
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Since — e, 0) < oo for any e > 0, we have, similarly to the proof of Theorem 13.11 


1 


limsup — logP(Li > n) < —ti = 6 \ 

n—>-oo 


(i,r) 


then We now consider the matrix geometric form of the stationary distribution; 

(i)„ _ .^(1) 


TZl U 




k^i £,j 


^ki 


, . . . '^ki 

k,i '' 




k,i 
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